The phase diagram of random threshold networks 
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Threshold networks are used as models for neural or gene regulatory networks. They show a rich 
dynamical behaviour with a transition between a frozen and a chaotic phase. We investigate the 
phase diagram of randomly connected threshold networks with real- valued thresholds h and a fixed 
number of inputs per node. The nodes are updated according to the same rules as in a model of 
the cell-cycle network of Saccharomyces cereviseae [PNAS 101, 4781 (2004)]. Using the annealed 
approximation, we derive expressions for the time evolution of the proportion of nodes in the "on" 
and "off" state, and for the sensitivity A. The results are compared with simulations of quenched 
networks. We find that for integer values of h the simulations show marked deviations from the 
annealed approximation even for large networks. This can be attributed to the particular choice of 
the updating rule. 
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I. INTRODUCTION 

Threshold networks can be used to model gene regula- 
tory networks [l|, 12, b| • The nodes of the network repre- 
sent genes, and the directed links between them represent 
interactions between genes. Each node i can be in two 
different states <7j = 1,0 ("on", "off"). That means that 
the gene is either expressed or not expressed. Further- 
more, each node receives inputs from K randomly cho- 
sen other nodes that regulate its activity cooperatively. 
The interactions between the nodes can be excitatory 
or inhibitory so that one node can activate or repress 
the expression of another node. In this paper, we study 
a threshold network where the time development of the 
states of the nodes is given by the following equation 
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Here, h is a threshold that is the same for every node. 
The couplings cy are ±1 with equal probability, cy = 
if node i receives no input from node j. The input 
Sij = C{j<jj from node j to node i can therefore take 
three different values: 0, +1 or — 1. A node becomes 
activated when the sum of its inputs exceeds the thresh- 
old value, and it becomes inactive when the sum of its 
inputs is below the threshold. When the sum of the in- 
puts gives exactly the threshold value the node does not 
change its state in the next time step. The nodes are up- 
dated in parallel. These dynamics with h = and a K 
value that varies from node to node were used to model 
the cell-cycle network of Saccharomyces cereviseae. This 
model was able to reproduce the overall dynamic proper- 
ties of the real network [2| ■ There exist several variants 
of threshold models. In other variants, the c^ can be 
continuous quantities chosen at random from some prob- 
ability distribution; the spin values may be ±1 instead 
of 1 and (see for instance [J, [a, 111 ) , or the update rule 
in the case that the sum of the inputs is exactly at the 
threshold can be different. 



Models that use spin values ctj = 1,0 can be mapped 
onto models with spin values r^ = ±1 by making the 
substitution <t, = (rj + l)/2. For our update rule |T]), 
this leads to 
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This means that each node i obtains its own threshold 
value hi, which depends on the values of the cy. There- 
fore the dynamics of the model studied in this paper is 
different from that of the ±1 model studied more widely. 
Similarly to random Boolean networks, random thresh- 
old networks show a transition between a frozen and a 
chaotic phase when the network parameters are varied. 
In the frozen phase, a perturbation at one node propa- 
gates during one time step on an average to less than one 
other node. In the chaotic phase, the difference between 
two initially almost identical states increases exponen- 
tially fast, because a perturbation propagates on an av- 
erage to more than one node during one time step. In the 
frozen phase, the length of attractors (i.e., the number of 
states on attractors) is either 1 or very small. Most of the 
nodes are frozen, that is they do not change their states 
anymore in the stationary state. In the chaotic phase, 
attractors are very long on average, and a non- vanishing 
proportion of the nodes change their states on the at- 
tractors. This phase transition was previously studied in 
threshold networks in [1, d, [a] . 



II. THE PHASE DIAGRAM 

With the help of the annealed approximation intro- 
duced by Derrida and Pomeau [7j, one can determine 
the parameter values h and K for which the networks 
are in the chaotic or in the frozen regime. This approxi- 
mation neglects that the input connections to nodes are 
constant in time (quenched). It describes therefore a sit- 
uation where the connections are changed randomly in 



each time step. The annealed approximation also ne- 
glects fluctuations and can therefore become exact only 
for infinitely large networks (if at all). The parameter 
A, called sensitivity [H, Q, which is K times the aver- 
age probability that the output of a node changes when 
one of its inputs changes, discriminates between the two 
phases. If A < 1, the network ensemble is said to be in 
the frozen phase. If A > 1 it is in the chaotic phase. For 
A = 1 the networks are critical. In order to determine 
A, one has to know b t , the proportion of nodes in state 1 
at the considered moment in time. A is a function of b t 
and becomes constant only when b t has reached a fixed 
point. 

The annealed approximation has been used success- 
fully to predict the phase diagram of various classes of 
random Boolean networks. In those networks, corre- 
lations between nodes are apparently irrelevant for the 
evaluation of bt and A. We will see further below that 
this is not correct for all threshold networks. 
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FIG. 1: Maps bt+i versus bt for K = 5 and different h. The 
dashed line is the bisector. 



therefore a second term when h is integer and becomes 



A. Time evolution of bt 

Let us first calculate bt+i as function of b t using the 
annealed approximation. For non-integer h, the value of 
a node will be 1 in the next time step if the sum of its 
inputs is larger than h. Therefore, 
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Here, m is the number of input nodes with value 1. For 
positive threshold values at least [^J + 1 of the input 
nodes must be active if the sum of the inputs shall be 
larger than the threshold. For the same reason, the num- 
ber I of positive (excitatory) couplings from these active 
input nodes must be at least [ m ^" fe J + 1. For negative h 
values all configurations with m < \h\ also contribute to 
the sum. There arc ( ) different possibilities to choose m 
active nodes among the K input nodes and (™) different 
possibilities to choose / excitatory links among the links 
from these active nodes. Finally bt" 1 (1 — bt) ~ m is the 
probability that m input nodes are in state Uj = 1 and 
the others in state <jj = 0, and (i) is the probability 
that positive and negative couplings are distributed as 
they are. 

For integer-valued h, the sum of the inputs can be 
exactly at the threshold, which is not possible for non- 
integer h. Within the annealed approximation, a node 
with the inputs at the threshold will be "on" with a prob- 
ability b t in the next time step. Equation §3§ obtains 
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Here, / is again the number of active input nodes with 
positive couplings. The number of active nodes with neg- 
ative couplings has to be I — h in order to place the sum 
of the inputs at the threshold. 

Having established the recursion relation for bt, one 
can plot maps bt+i vs. bt for different h and K. The 
fixed points b* of the map (see figure [1]) are stationary 
solutions of the annealed approximation. 

A fixed point b* = exists whenever the smallest m 
contributing to the sum in ([3|) is larger than 0. This is 
the case for all ft > 0. The fixed point b* = is stable 
when the slope of the map at bt = is smaller than 1, 
which is the case for all h > 1. For < h < 1, the 
map is b t +\ = Kb t /2 to leading order in b t , and the 
fixed point b* = is therefore unstable for K > 2. For 
K = 2, we have to include the next order in bt, which 
gives bt+i = bt(l — 36t/4), and therefore the fixed point 
b* = is stable. For h = 0, we have to leading order 
b l+ i = b t (l + K/2), and the fixed point b* = is therefore 
unstable. 

In order to obtain information about other fixed points, 
we iterated numerically the recursion relations for b t and 
plotted the map. We found that for h > 1 and sufficiently 
small K, the only stable fixed point is b*^ = 0, but for 
growing K a second stable fixed point appears. Figure 
[2] shows how the map changes with increasing K when 
h = 1. A second stable fixed point with b< 2) = 0.200 
appears at K = 12. It moves with increasing K slowly 
towards the value 0.5, which is the asymptotic value for 




FIG. 2: Maps bt+i versus bt for ft = 1 and different K. The 
dashed line is the bisector. 



K — ► oo. For < h < 1 and A" = 2, the only fixed point 
is fe* = 0. For K > 2, this fixed point is unstable, as 
mentioned before, and there exists a stable fixed point 
with a value < b* < 0.5. ft moves towards 0.5 with 
increasing A. For h = 0, there is only one stable fixed 
point b* = 0.5 for all values of A. For h < 0, the stable 
fixed point lies between 0.5 and I and moves towards 0.5 
with increasing A. 

For K = 1, all fixed points can be determined ana- 
lytically. For h > 1, the input of no node can be above 
the threshold, and there is no fixed point besides b* = 0. 
Similarly, for h < — 1 the inputs of all nodes are above 
the threshold, and therefore b* = 1 . Evaluation of the re- 
cursion relation for the remaining values of h gives b* = 1 
for h = -1 and b* = 2/3 for -I < h < and fe* = 1/2 
for /i = and &* = for /i > 0. 
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FIG. 3: Phase diagram obtained from the annealed approx- 
imation. The chaotic phase (A > 1) is indicated in red, 
the frozen phase (A < 1) in green, and the critical region 
(A = 1) in yellow. For integer h the phases are indicated 
by darker shades of the colours. (In black and white the 
lighter colours indicate the frozen phase, the darker colours 
the chaotic phase.) 



The factor 1/2 is the probability that the Ath coupling 
has the proper sign. 

For integer h, the situation is again different. A change 
in an input can affect the output only if the sum of all 
inputs was h before the change. In the opposite situation, 
where a change in an input places the total input exactly 
at the threshold, the output does not change. (If we took 
the annealed approximation to its extremes and ignored 
the fact that there is a correlation between the state of 
a node and the state of its inputs, we would need to 
consider also the case that the sum of the inputs is h ± 1 
before the change of one input node.) 



We therefore obtain for integer h 



Having found a fixed point b* for a pair of parameter 
values h and A, one can determine the corresponding 
value of A. For non-integer h, the change of an input 
can affect the output only when the other K — 1 inputs 
sum up to be directly above or directly underneath the 
threshold. This leads to 
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Here, m is again the number of active input nodes. The 
number of active input nodes with positive couplings, 
/ = [ '" + 2 +/l J , is chosen in such a way that 21 — m is close 
to the threshold (directly underneath or directly above). 
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Using the last two equations, one can evaluate A for 
every combination of h and A. The resulting phase di- 
agram is shown in Figure [3] Only networks with K = 2 
and a threshold value < h < 1 are critical. Networks 
with h > 1 are frozen in the A range shown. Where there 
are two stable fixed points for h> \ networks are frozen 
at b* — and chaotic at b* > 0. For h < 1, networks with 
integer h are more ordered than those with non-integer 
h. 



III. NUMERICAL SIMULATIONS 

We performed computer simulations of quenched 
threshold networks for different h and K and compared 
the results to those obtained in the framework of the 
annealed approximation. The number of nodes was 
N = 10 5 in all simulations. The threshold values were 
chosen in the range — 3 < h < +3, with non-integer 
thresholds chosen to be h = —2.5,-1.5, . . . , 1.5, 2.5. All 
non-integer thresholds that lie between the same two in- 
tegers lead obviously to the same dynamical behaviour, 
therefore it is sufficient to consider these values. 

We will first look at the value bf found after a suffi- 
ciently long time when starting with some initial propor- 
tion 6q of Is in the system. 



A. The proportion of Os and Is 
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FIG. 4: The final proportion of Is in dependence of the initial 
proportion of Is in networks with h — 1 and different values 
of K. Each data set corresponds to one network realization. 



1. h>0 

For non-integer h, the simulations are in good agree- 
ment with the predictions of the annealed approximation. 
h = 0.5: The only fixed point for K = 2, b* = 0, is 
weakly stable because the map has a slope of 1 at this 
point. Most simulated networks do not reach this fixed 
point but run into attractors of varying length with a 

. This is due to the fact that 
bt(l — 36t/4) can be applied 



small bf of the order of 10 
the iteration formula bt+i 



only as long as b\ is larger than of the order 1/N. The 
negative quadratic term in this equation describes the 
repressive effect of a second active input with a negative 
coupling. The decrease of bt comes to a halt when bt has 
become so small that there are no more nodes with two 
active inputs, which will happen for ever smaller values of 
bt when the system size is made larger. The discrepancy 
between the simulations and the annealed approximation 
is thus clearly a finite-size effect. 

For K = 3 and 4, the mean b values of the quenched 
networks are in good agreement with the calculated val- 
ues (we checked for agreement in three decimal places). 

/;, = 1.5: For non-integer h, the nonzero fixed point 
value b* appears at K values that are in accordance with 
the annealed approximation. For h = 1.5, this happens 
at K = 15. The average b value obtained from our sim- 
ulations shows however a small deviation of about 1% 
from the calculated value. We can ascribe this small dis- 
crepancy again to finite-size effects, since the slope of the 
map near the fixed point is close to 1 for the K value 
where this fixed point occurs first. For K = 16 and 17, 
the values are again in good agreement. 

h = 2.5: For h = 2.5, a stable fixed point value b* > 
appears at K = 40, just as predicted by the calcula- 
tions. The value of b* obtained from the simulations and 
averaged over the attractor agrees with the one obtained 
from the annealed approximation in three decimal places. 
Such a good agreement is also found for K = 41 and 42. 



The case of integer h is special, and we will see that in 
this situation the simulations are not in good agreement 
with the annealed approximation. 

h = 1: For networks with a K value ranging from 
2 to 11, the annealed approximation predicts a single 
stable fixed point b* = 0. In contrast, our simulations 
show that already for K = 5 there exist stationary states 
with a larger number of active nodes, and the value b* 
approached for large times depends on the initial value 
bo (see figure EJ . Each curve in figure |4] corresponds to 
one network realization. Each point in the figure is a 
fixed point of the dynamics, that is an attractor of length 
one. As one can see, two different networks with the 
same values of K and h show approximately the same 
behaviour. This means that the function 6/(&o) does not 
depend on the detailed realization of the networks. For 
networks with K = 5, the nonzero fixed point appears 
when the initial proportion of Is is around 50%. 

Only for K > 12, the annealed approximation predicts 
a stable fixed point b* > 0. For such K values, our sim- 
ulations give a value bf that is independent of bo if &o 
is not too small. If one compares the value b* obtained 
by iterating formula |4] with the value obtained by aver- 
aging over several simulated networks, one finds that the 
quenched networks have around 41% more active nodes 
than predicted by the annealed approximation, in the 
publications cited above, where all nodes have the same 
threshold value. With increasing K, this deviation from 
the annealed approximation decreases. It is about 25% 
for K = 13 and about 20% for K = 14. 

In order to understand how a broad set of dynamical 
fixed points can emerge in these systems, we note the fol- 
lowing: (a) At every fixed point, there are nodes the sum 
of whose inputs is at the threshold. If changing the state 
of such a node does not change the state of any node 
influenced by it, we have found another fixed point with 
a different number of active nodes, (b) All fixed points 
of a network with h = 1.5 or with h = 0.5 are also fixed 



points of this network if h = 1. One can expect that all 
observed fixed points should have b values between these 
two boundary values, and this is indeed observed, (c) If 
there exists a set of fixed points with different b values, 
the final value of b reached in a simulation should de- 
pend on the initial value. This in turn means that the 
state of a node at a fixed point depends on the dynamical 
history of this node and its inputs. Such correlations be- 
tween the states of a node at different moments in time 
are not taken into account in an annealed approximation, 
which is therefore no good approximation in this situa- 
tion. With increasing K, the curves in figure H] become 
increasingly independent of bo . This can be attributed to 
increasing transient times, which weaken the "memory" 
of the initial state of the nodes, (d) There can exist sets 
of active nodes that are connected by positive directed 
links among each other in a way that loops are formed. 
When the sums of all other inputs to the nodes in such 
loops are zero, they are at the threshold and once ac- 
tivated will keep their value. Correlations of this type 
between nodes arc not included in annealed models. 

h = 2 and 3: For networks with a threshold value 
h = 2, a second stable fixed point value b* appears at 
K = 35 in the annealed approximation, but can be found 
in quenched networks already for K = 31. At K = 35, 
the second stable fixed point b* is about 36% higher than 
the value predicted by the annealed approximation, and 
this difference decreases to 26% and 21% for K = 36 
and K = 37. For h = 3, a second stable fixed point 
appears also at a lower K (at K = 65) than expected 
from the annealed approximation, where it appears at 
K = 70. The value of b* reached at K = 70 is about 
29% higher than the expected value. We find a deviation 
of about 23% and 20% for K = 71 and K = 72. All 
observed b values are between those obtained for h = 1.5 
and h = 2.5 if h = 2, and between those obtained for 
h = 2.5 and h = 3.5 if h = 3. 



2. h = 

For h = and K ranging from K = 2 to 5 we again 
find many dynamical fixed points that have a bf different 
from the value calculated with the help of the annealed 
approximation, see figure [5) With increasing K however, 
bf approaches the expected value. 

In Figure one can observe another interesting effect, 
which occurs also for all other integer h and for not too 
large K values. Depending on the sum of h and K, the 
curves exhibit different behaviour at high bo values. If 
(h + K) is even, bf increases at the end as in this case 
it is more likely that the inputs of a node are at the 
threshold than for odd (h + K). 

Considering the trivial case K = 1 is also instructive: 
Every node has exactly one input. Starting from a ran- 
domly chosen node, we can follow the chain of inputs 
preceding this node. For large system sizes, the average 
length of such chains is long (it is of the order of y/~N) [l(| . 




FIG. 5: The final proportion of Is in dependence of the initial 
proportion of Is in networks with h — and different values 
of K. Each data set corresponds to one network realization. 



Every chain eventually ends in a loop. Along the chain, 
positive and negative couplings follow in a random order. 
We can easily find the fixed points of such a system of 
chains: Obviously, having all nodes in state is a fixed 
point of the dynamics. If we then switch on a node that 
has only negative output links, we obtain another fixed 
point. If we switch on a node that has a positive output 
link, the node influenced through this link must also be 
switched on, and so on, until the end of the sequence of 
positive couplings is reached. The fixed point with the 
maximum number of "on" nodes is obtained by assigning 
a 1 to all nodes with a positive input link and to all those 
nodes with a negative input link that are preceded by an 
odd number of nodes with a negative input link. In this 
way, all nodes that have a negative input link and an in- 
put node in state 1, are in state 0. The b value associated 
with this fixed point is 
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n=0 



If we had — 1 < h < 0, this would be the only fixed 
point. The example K = 1 thus demonstrates that the 
maximum possible fixed point value for b for integer h 
is identical to the one obtained by slightly lowering the 
value of h. Similarly, the minimum value is the fixed 
point value obtained if h is slightly larger than 0. All in- 
termediate values of b for h = are obtained by switching 
off part of the "on" nodes in the state with the maximum 
b value. 

This example demonstrates also that not all fixed point 
values of b can be reached from a random initial state. 
For instance, the maximum value 2/3 of b cannot be 
reached by starting from such a random initial config- 
uration. If initially all nodes are in state 1, i.e. if bo = 1, 
we have after 1 time step b = 1/2, where all nodes with 
a positive input link are in state 1. If there are less Is 
initially, there cannot be more Is in the final state. Val- 
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tors and the number of nodes that change their states 
while the network is moving through the attractor. We 
consider the networks at the different possible fixed point 
values b* . A fixed point of b in the annealed approxima- 
tion does not necessarily imply that the network dynam- 
ics reaches a fixed point in state space (i.e. a dynamical 
fixed point). In our simulations, all attractors in state 
space have a constant value of b (with some fluctuations 
around it because the system size is finite) , which means 
that the proportion of nodes changing their state from f 
to is at each step approximately equal to the proportion 
of nodes changing their state from to 1, as suggested by 
the annealed approximation. We compare the results of 
the simulations with the A values calculated within the 
annealed approximation. 



FIG. 6: The final proportion of Is in dependence of the initial 
proportion of Is in networks with K — 4 and different negative 
h. Each data set corresponds to one network realization 



ues between 1/2 and 2/3 can therefore only be reached 
by starting from specially prepared initial states. This 
observation for K = 1 explains why the simulations for 
larger K (and also for other integer h) give b values be- 
tween those obtained with the annealed approximation 
for the neighbouring non-integer h values, but not the en- 
tire b interval between these boundaries is reached from 
a random initial state with fixed b. 

The fact that the agreement between the annealed ap- 
proximation and the quenched networks becomes better 
for larger K can be ascribed to the narrowing of the in- 
terval between the boundaries with growing K. 



3. h<0 

Figure [5] shows the final b value as a function of the 
initial b value for networks with K = 4 and different neg- 
ative h. (For the parameter values shown all networks 
have A < 0, that is they are frozen.) As one can see, for 
non-integer h the final proportion of Is in the network 
does not depend on bo. Again the values of bf obtained 
with the simulations agree well with those obtained us- 
ing the annealed approximation. For integer h, we find 
dynamical fixed points with a value bf that depends on 
bo . The mean value of bf is always smaller than the value 
predicted by the annealed approximation. The values of 
bf for the networks with integer h always lie between 
those of networks that have neighbouring non-integer h 
values with the same K, as we have also observed for 
non-negative integer values of h. 



1. h>0 

The only parameter combination for which the consid- 
ered networks can be critical is h = 0.5 and K = 2. The 
attractors found in the simulations have lengths of one to 
four digits, the number of nodes that change their state 
on the attractors is of the order of 10 3 , which is com- 
patible with the expected number of the order of N 2 ^ 3 

B 

For K > 2 and h = 0.5, the networks should be chaotic 
according to the annealed approximation. In the simula- 
tions, the attractors are longer than our search range 
(max. transient length: 10 5 , max. attractor length: 
10 4 ) which is consistent with the expectation of having 
a chaotic network. The annealed approximation predicts 
furthermore that networks with larger h are frozen when 
the only stable fixed point is b* = 0. Networks with 
K values for which a second stable fixed point b* > 
exists have A > 1 at this fixed point and should there- 
fore be chaotic. Simulations of networks with non-intcger 
h = 1.5 and 2.5 show results that are consistent with 
this prediction. Quenched networks with integer h show 
again deviations. For h = 1 and K = 12, even net- 
works with b values at the second fixed point 6* > are 
frozen and not chaotic. For h = 1 and K = 13, no at- 
tractors are found within the search range, pointing at 
chaotic dynamics. For h — 2 the situation is different. As 
stated in the previous section, a second stable fixed point 
b* > appears already at K = 31, and the networks show 
chaotic behaviour at this fixed point. According to the 
annealed approximation, the first chaotic network should 
have K = 35. The same is true for networks with h = 3: 
they are chaotic when they reach the second stable fixed 
point b* , but this fixed point appears for K values smaller 
than predicted by the annealed approximation. 



B. The phase diagram 



2. h = 



Next, we report on the dynamical properties of the 
simulated networks, that is the lengths of their attrac- 



For h — 0, the situation is similar to that for h = 
1. According to the annealed approximation networks 



should be chaotic from K = 13 on. But in all simulations 
of networks with connectivities up to K = 16 we find only 
fixed point attractors, which means that these networks 
are in the frozen phase. 



calculated phase transitions do not occur at the same K 
values as those obtained by computer simulations when 
ft is integer. 



3. h<0 



IV. DISCUSSION 



For ft, < 0, we first chose the values of ft and K such 
that the networks are expected to be in the frozen phase, 
and we found fixed point attractors in all simulations. 
Then we took a closer look at parameter values close to 
the transition between ordered and chaotic dynamics (cf. 
figure [3]). For integer ft, we found again deviations from 
the annealed approximation. Just as for ft, = and 1, 
the frozen phase is extended to higher K values. This 
means that we find networks with fixed point attractors 
only in regions of the parameter space where they should 
be chaotic according to the annealed approximation. For 
non-integer ft = —0.5 and —2.5, chaotic networks should 
be found for K > 5 and K > 11 respectively. In all 
simulations with these parameters, the attractor lengths 
exceeded the search range. For ft = —0.5 and K = 4, 
on the other side of the phase boundary where networks 
are expected to be frozen, we find mostly short attrac- 
tors with less than 1% of the nodes changing their state. 
The major part of these networks is frozen, in agree- 
ment with the calculated value A w 0.995. For ft. = —2.5 
and K = 10, the situation is similar. For ft = —1.5, 
the annealed approximation predicts chaotic dynamics 
for K > 7. But since A ~ 1.008 for K = 7, we are very 
close to the boundary for this parameter value. The sim- 
ulated networks have attractor lengths ranging from one 
digit to values exceeding the search range. For K = 6, 
we have A « 0.903, and the attractors are short, with less 
than 1% of the nodes changing their values. 

To summarize, the phase diagram figure [3] obtained 
by the annealed approximation is valid for the quenched 
system for all non-integer ft. For integer h < 1, the tran- 
sition from the frozen to the chaotic phase occurs at a 
larger value of K than predicted by the annealed ap- 
proximation, and for integer ft. > 1 it occurs at a smaller 
value. Since most of these transitions do not lie in the 
window of K values shown in figure [3l the corresponding 
figure obtained from our simulations looks hardly differ- 
ent, therefore we do not include it. 

The reason why the transitions from the frozen to the 
chaotic phase do not occur for the K values predicted 
by the annealed approximation when ft is integer, is the 
same as the reason why the stationary values bf do not 
agree with the fixed points calculated with the annealed 
approximation. For integer ft, the annealed approxima- 
tion does not capture correctly the dynamical properties 
of the system, because it neglects memory effects. Even 
when we evaluate A within the annealed approximation 
by using the values bf obtained from the simulations, the 



We investigated the phase diagram of threshold net- 
works with real-valued thresholds and an updating rule 
that does not change the state of a node when the sum of 
its inputs gives exactly the threshold value. We compared 
the analytical results obtained by using the annealed ap- 
proximation with the results obtained from computer 
simulations. We evaluated the proportion b of Is in the 
networks and the sensitivity A to changes of the state of 
an input. We found that the annealed approximation is 
valid in the case of non-integer thresholds, but that it 
does not agree with the simulations in the case of inte- 
ger thresholds. We ascribed this discrepancy to memory 
effects that are not captured by the annealed approxi- 
mation. In the studies mentioned before [4j, |5j, [g], this 
situation did not occur, and the annealed approximation 
was sufficient to calculate the phase transitions correctly. 

Let us now briefly return to the model of the cell-cycle 
network of yeast Q , which motivated us to study thresh- 
old networks with this special kind of updating rule. This 
model consists of 11 nodes, and it shows seven fixed 
points. The dominant fixed point corresponds to the 
Gl phase of the cell cycle, during which the cell grows. 
Although the trajectory corresponding to the cell cycle 
is impressively stable, the dominant fixed point is very 
sensitive to specific perturbations at certain nodes [12j | . 
When the state of one of the 11 nodes is changed, the 
network returns to the fixed point only in 6 out of the 
11 cases. In the other cases, the dynamics is attracted 
to one of the other fixed points of the network. 6 of 
the 7 fixed points can be reached from other fixed points 
by changing only one node, and there is a group of three 
nodes amongst which all these changes occur. The inputs 
of all three nodes are at the threshold, and changing the 
state of one of these nodes does not change the state of 
any other node. As we have seen in this paper, such a 
set of fixed points, which differ by the state of one node, 
is characteristic of a threshold network with an integer- 
valued threshold. It is due to the update rule that a 
node keeps its state when the sum of its inputs is exactly 
at the threshold. This raises the question whether the 
non-dominant fixed points have a biological meaning, or 
whether they are just artefacts of the update rules of the 
model. 
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